PII Detection - 11 Model Benchmark Report

300 Test Cases (Base 200 + Advanced 100) · V1 Full Prompt · FP8 Quantization · NVIDIA L40S 46GB

F1 Score Comparison
Detailed Statistics
ModelCasesPerfectAccuracy PrecisionRecallF1 TPFPFN Latency
Confusion Matrix (Document-Category Level)

TP = PII exists & detected (good), TN = No PII & not detected (good), FP = No PII but detected (false alarm), FN = PII exists but missed (privacy risk)

Sensitivity = TP/(TP+FN), Specificity = TN/(TN+FP)

Per-Category Confusion Matrix
Category TPTN FPFN SensitivitySpecificity
Case Browser
Model
Dataset
Result
PII